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C Abstract We study the asymptotic behavior of the least squares 

estimators of the unknown parameters of general pth-order bifurcat- 

rvj ing autoregressive processes. Under very weak assumptions on the 

^ driven noise of the process, namely conditional pair-wise indepen- 

OO dence and suitable moment conditions, we establish the almost sure 

OQ convergence of our estimators together with the quadratic strong law 

l/~) and the central limit theorem. All our analysis relies on non-standard 

>— ^ asymptotic results for martingales. 

1. Introduction. Bifurcating autoregressive (BAR) processes are an 
adaptation of autoregressive (AR) processes to binary tree structured data. 
They were first introduced by Cowan and Staudte |2 for cell lineage data, 
where each individual in one generation gives birth to two offspring in the 
/\ next generation. Cell lineage data typically consist of observations of some 

quantitative characteristic of the cells over several generations of descen- 
dants from an initial cell. BAR processes take into account both inherited 
and environmental effects to explain the evolution of the quantitative char- 
acteristic under study. 
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More precisely, the original BAR process is denned as follows. The initial 
cell is labelled 1, and the two offspring of cell n are labelled In and 2n + 1. 
Denote by X n the quantitative characteristic of individual n. Then, the 
first-order BAR process is given, for all n > 1, by 



X-2n 


= a 


+ 


bX n 


+ 


£2n, 


X2n+1 


= a 


+ 


bX n 


+ 


£2n+l 



The noise sequence (£2n^2n+i) represents environmental effects while a, b 
are unknown real parameters with |6| < 1. The driven noise (£2n,£2n+i) was 
originally supposed to be independent and identically distributed with nor- 
mal distribution. However, two sister cells being in the same environment 
early in their lives, e^n and S2 n +i are allowed to be correlated, inducing a 
correlation between sister cells distinct from the correlation inherited from 
their mother. 

Several extensions of the model have been proposed. On the one hand, we 
refer the reader to Huggins and Basawa [10] and Basawa and Zhou [TJ [15] 
for statistical inference on symmetric bifurcating processes. On the other 
hand, higher order processes, when not only the effects of the mother but 
also those of the grand-mother and higher order ancestors are taken into 
account, have been investigated by Huggins and Basawa [10 : . Recently, an 
asymmetric model has been introduced by Guyon [5] |6] where only the effects 
of the mother are considered, but sister cells are allowed to have different 
conditional distributions. We can also mention a recent work of Delmas and 
Marsalle |3^ dealing with a model of asymmetric bifurcating Markov chains 
on a Galton Watson tree instead of regular binary tree. 

The purpose of this paper is to carry out a sharp analysis of the asymptotic 
properties of the least squares (LS) estimators of the unknown parameters 
of general asymmetric pth-order BAR processes. There are several results on 
statistical inference and asymptotic properties of estimators for BAR mod- 
els in the literature. For maximum likelihood inference on small independent 
trees, see Huggins and Basawa [10]. For maximum likelihood inference on a 
single large tree, see Huggins [9] for the original BAR model, Huggins and 
Basawa |llj for higher order Gaussian BAR models, and Zhou and Basawa 
|15j for exponential first-order BAR processes. We also refer the reader to 
Zhou and Basawa |14] for the LS parameter estimation, and to Hwang, Ba- 
sawa and Yeo [12 j for the local asymptotic normality for BAR processes and 
related asymptotic inference. In all those papers, the process is supposed to 
be stationary. Consequently, X n has a time-series representation involving 
an holomorphic function. In Guyon [5], the LS estimator is also investigated, 
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but the process is not stationary, and the author makes intensive use of the 
tree structure and Markov chain theory. Our goal is to improve and extend 
the previous results of Guyon [5] via a martingale approach. As previously 
done by Basawa and Zhou [U [IJJ [15] we shall make use of the strong law of 
large numbers j3j as well as the central limit theorem [JJ 18] for martingales. 
It will allow us to go further in the analysis of general pth-order BAR pro- 
cesses. We shall establish the almost sure convergence of the LS estimators 
together with the quadratic strong law and the central limit theorem. 

The paper is organised as follows. Section [2] is devoted to the presenta- 
tion of the asymmetric pth-order BAR process under study, while Section [3] 
deals with the LS estimators of the unknown parameters. In Section [4] we 
explain our strategy based on martingale theory. Our main results about the 
asymptotic properties of the LS estimators are given in Section [5} More pre- 
cisely, we shall establish the almost sure convergence, the quadratic strong 
law (QSL) and the central limit theorem (CLT) for the LS estimators. The 
proof of our main results are detailed in Sections 6 to 10, the more technical 
ones being gathered in the appendices. 

2. Bifurcating autoregressive processes. In all the sequel, let p be 
a non-zero integer. We consider the asymmetric BAR(p) process given, for 
all n > 2P" 1 , by 



(2.1) 




a 

bo 



+ 



E p 



fc=i 



OfcA"[_ 



+ 



+ TL 1 b k X [ n ] + 



£2n, 
£2n+l) 



where [x] stands for the largest integer less than or equal to x. The initial 
states {X^, 1 < k < 2 P_1 — 1} are the ancestors while (s2n,£2n+i) is the 
driven noise of the process. The parameters (ao, ai, . . . a p ) and (bo, &i, . . . , b p ) 
are unknown real numbers. The BAR(p) process can be rewritten in the 
abbreviated vector form given, for all n > 2 p ~ l , by 



(2.2) 



^2/i 
^2ra+l 



where the regression vector X ra 

V2n+i = (b + £2n+i)ei with ei 
the p x p companion matrices 



AX r , 
BX r 



\X n ,Xv 



+ 
+ 



V2n, 

V2n+1, 



r ]) 4 ,??2n. = (ao+£2n)ei, 
'1,0,..., 0)* G W. Moreover, A and B are 



A 



( o,\ 

1 



V ° 



«2 





a p \ 



J 



B 



1 


V ° 



b 2 
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This process is a direct generalization of the symmetric BAR(p) process 
studied by Huggins, Basawa and Zhou |10[ HPi] . One can also observe that, 
in the particular case p = 1, it is the asymmetric BAR process studied 
by Guyon [5j [6]. In all the sequel, we shall assume that E[X|] < oo for all 
1 < k < 2 P_1 — 1 and that matrices A and B satisfy the contracting property 

/J = max{||A[|,||.B||} < 1, 

where ||A|| = sup{||Au||, u ^W with ||n|| = 1}. 




Figure 1. The tree associated with the bifurcating auto-regressive process. 



As explained in the introduction, one can see this BAR(p) process as apth- 
order autoregressive process on a binary tree, where each vertex represents 
an individual or cell, vertex 1 being the original ancestor, see Figure [T] for 
an illustration. For all n > 1, denote the nth generation by 



{2 n ,2 n + l,...,2 



ra+l 



!}• 



In particular, Go = {1} is the initial generation and Gi = {2, 3} is the first 
generation of offspring from the first ancestor. Let G rn be the generation 
of individual n, which means that r n = log 2 (n). Recall that the two off- 
spring of individual n are labelled 2n and 2n + 1 , or conversely, the mother 
of individual n is [rt/2]. More generally, the ancestors of individual n are 
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[n/2], [n/2 2 ], . . . , [n/2 Vn ]. Furthermore, denote by 



T, 



fc=0 



the sub-tree of all individuals from the original individual up to the nth 
generation. It is clear that the cardinality \G n \ of G n is 2 n while that of 
T n is |T n | = 2 n+1 - 1. Finally we denote by T n>p = {k G T n ,k > 2?} the 
sub-tree of all individuals up to the nth generation without T p _i. One can 



observe that, for all n > 1, T Wj o = ^n and, for all p > 1, X 



p,p 



G 



v 



3. Least-squares estimation. The BAR(p) process (2.1 ) can be rewrit- 
ten, for all n > 2 P_1 , in the matrix form 



(3.1) 
where 



% + V n 



X2n 

X2n+1 



Yn 



V„ 



£2n 
£2n+l 



and the {p + 1) x 2 matrix parameter 9 is given by 

/ a b \ 
a\ b 1 

\ a p b p J 

Our goal is to estimate 6 from the observation of all individuals up to the 
nth generation that is the complete sub-tree T n . Each new generation G n 
contains half the global available information. Consequently, we shall show 
that observing the whole tree T n or only generation G n is almost the same. 
We propose to make use of the standard LS estimator 8 n which minimizes 

1 

2 



A «W = ii E II z k - ® tY k 



keT n -l,p-l 

Consequently, we obviously have for all n > p 



(3.2) 



On — S, 



/j-i 7 , 
fceT„_i . 



YkZk, 



where the (p + 1) x (p + 1) matrix S n is defined as 

S n = 2^1 YkY k = E ( X k 
keT„ }P -i keT n , P -i \ 
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In the special case where p = 1, S n simply reduces to 



fcgT„ \ 



1 x k 
x k xl 



In order to avoid useless invertibility assumption, we shall assume, without 
loss of generality, that for all n > p — 1, S n is invertible. Otherwise, we only 
have to add the identity matrix I p+ i to S n . In all what follows, we shall 
make a slight abuse of notation by identifying 6 as well as 6 n to 



/ a \ 



vec(9) 



and 



vec 



V b p J 



( ao,n \ 



bo,n 



\ bp, n J 



The reason for this change will be explained in Section |4j Hence, we readily 
deduce from (3.2 1 that 



o n = Ofeas-ii) E vec ( y fc4) 



fceT n _ 



i,p-i 



(h^s-^) e 

fcST n _i iP _i 



( x 2k \ 

Xk^2k 
X 2 k+1 

V x k x 2 k+i j 



where ® stands for the matrix Kronecker product. Consequently, it follows 



from (3.1 ) that 



(W) 



e = (i 2 ®s^i) E vec 

( £2k \ 



(3.3) 



(i 2 ®s^i) E 

keT n -l,p-l 



^2k^k 

£2k+l 

V e 2k+h&k j 



Denote by F = (J- n ) the natural filtration associated with the BAR(p) pro- 
cess, which means that J- n is the a- algebra generated by all individuals up 
to the rath generation, T n = (j{X k , k G T n }. In all the sequel, we shall make 
use of the five following moment hypotheses. 
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(H.l) One can find a 2 > such that, for all n > p — 1 and for all k E G n +i, 
£fc belongs to L 2 with 

E[s k \F n } = and E[e||^" n ] = a 2 a.s. 

(H.2) It exists \p\ < a 2 such that, for all n > p — 1 and for all different 
k,l E G n +i with [jfe/2] = [Z/2], 

E[e fc ej|.F n ] = p a.s. 

Otherwise, £& and e\ are conditionally independent given T n . 
(H.3) For all n > p — 1 and for all A; E G n +i, £k belongs to L and 

sup sup Efe^l^] < oo a.s. 

n>p— 1 fceG n +i 
(H.4) One can find r 4 > such that, for all n > p — 1 and for all fc E G n +i, 

E[4|.F n ] = r 4 a.s. 

and, for v 2 < r 4 and for all different k, I E G n +i with [k/2] = [1/2] 

^[ £ 2k £ 2k+lWn\ = V a.S. 

(H.5) For all n > p — 1 and for all k E G n +i, e^ belongs to L 8 with 

sup sup E[ef I.F7J < oo a.s. 

n>p— 1 fceGn+i 

Remark 3.1. In contrast with fl^j , one can observe that we do not assume 
that (£2n>£2n+i) is a sequence of independent and identically distributed bi- 
variate random vectors. The price to pay for giving up this iid assumption 
is higher moments, namely assumptions (H.3) and (H.5). Indeed we need 
them to make use of the strong law of large numbers and the central limit 
theorem for martingales. However, we do not require any normality assump- 
tion on (e2n, £ 2n+i)- Consequently, our assumptions are much weaker than 
the existing ones in previous literature. 

We now turn to the estimation of the parameters a 2 and p. On the one hand, 
we propose to estimate the conditional variance a 2 by 

(3-4) 8£ = — L-, £ ||t4|| 2 =-^ ]T (4, + 4m) 

Sfcln- 1,J>— 1 Kfcl n _i iP _i 
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where for all n > p — 1 and for all k £ G n , V£ = (£2k, £2fc+l) with 

£2fc = X 2 k — ao,n — Z/i=l a-i^nX, h i , 

?2fc+l = -^2fc+l — &0,n — T^i-l bj, n X] h ]■ 

L 2 J-U 

One can observe that, on the above equations, we make use of only the past 
observations for the estimation of the parameters. This will be crucial in 
the asymptotic analysis. On the other hand, we estimate the conditional 
covariance p by 

(3-5) p n = -pjs 1 2_/ ^2fc£2fc+l- 

4. Martingale approach. In order to establish all the asymptotic 
properties of our estimators, we shall make use of a martingale approach. 
It allows us to impose a very smooth restriction on the driven noise (e n ) 
compared with the previous results in the literature. As a matter of fact, 
we only assume suitable moment conditions on (e„) and that (e2n ; ^2n+i) 
are conditionally independent, while it is assumed in [H] that (£2n,£2n+i) 
is a sequence of independent identically distributed random vectors. For all 
n> p, denote 



M n = £ 

fceT n _i, p _i 



/ £2k \ 

£2fcXfc 

£2fc+l 
V £2fc+lXfc J 



p2(p+l) 



Let E n = I2 <8> S n , and note that E n * = I2 <8> S n . For all n > p, we can thus 



rewrite (3.3) as 

(4.1) 9 n - 9 = E-^Mn. 

The key point of our approach is that (M n ) is a martingale. Most of all 
the asymptotic results for martingales were established for vector-valued 
martingales. That is the reason why we have chosen to make use of vector 
notation in Sectional In order to show that (M n ) is a martingale adapted to 
the filtration F = (J- n ), we rewrite it in a compact form. Let \l/ n = I2 <8> $ 
where <3? n is the rectangular matrix of dimension {p+ 1) x S n , with 8 n = 2 n 
given by 

*. = ( ' ' "' ' )■ 

\ X2" X2«-|-l • • • X2n+i_i / 



n- 
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It contains the individuals of generations G n _ p +i up to G n and is also the 
collection of all Y/., k £ G n . Let £ n be the random vector of dimension 5 n 

( £2™ \ 

£2 n +2 



e 2 «+i-2 

£2™+l 
£2 n +3 

y £ 2 n+l_l J 



The vector £ n gathers the noise variables of generation G n . The special 
ordering separating odd and even indices is tailor-made so that M n can be 
written as 

n 
k=p 

By the same token, one can observe that 



s n = J2 ***£ 

k=p—l 



and S n = Y, ****■ 

k=p—l 



Under (H.l) and (H.2), we clearly have for all n > 0, E[£ n+ i|jF n ] = and 
VP n is ^-measurable. In addition, it is not hard to see that for all n > 0, 
E[^ n+ i^ +1 |J : n ] = T (g) Lj n where Y is the covariance matrix associated with 

(£2n,£2n+l) 



° 2 P 



P o 



We shall also prove that (M n ) is a square integrable martingale. Its increas- 
ing process is given for all n > p + 1 by 



<M> r 



n—1 n—1 

X; * fc (r®ij fc )*« fc = r® X 

k=p—l k=p—l 



***** 



r (8)5 n -l. 



It is necessary to establish the convergence of £„, properly normalized, in 
order to prove the asymptotic results for the BAR(p) estimators 9 n , a\ and 
p„. One can observe that the sizes of *ff n and £ n are not fixed and double 
at each generation. This is why we have to adapt the proof of vector- valued 
martingale convergence given in j3] to our framework. 
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5. Main results. We now state our main results, first on the martingale 
(M n ) and then on our estimators. 

Proposition 5.1. Assume that (e„) satisfies (H.l) to (H.3). Then, we 
have 

(5.1) lim — — = L a.s. 
V ; "-°° |T n | 

where L is a positive definite matrix specified in Section^ 

This result is the keystone of our asymptotic analysis. It enables us to prove 
sharp asymptotic properties for (M n ). 

Theorem 5.1 Assume that (e n ) satisfies (H.l) to (H.3). Then, we have 

(5.2) M^-^Mn = 0{n) a.s. 
In addition, we also have 

1 n 

(5.3) lim - V M!Er_,Mfe = 2(p + 1W 2 a.s. 

n — >oc 77, ^ — d 
k=p 

Moreover, if (e n ) satisfies (H.4) and (H.5), we have the central limit theo- 
rem 

(5.4) -^M„i#,r®L). 

From the asymptotic properties of (M n ), we deduce the asymptotic behavior 
of our estimators. Our first result deals with the almost sure asymptotic 
properties of the LS estimator 9 n . 

Theorem 5.2. Assume that (e n ) satisfies (H.l) to (H.3). Then, 9 n con- 
verges almost surely to 9 with the rate of convergence 

(kc\ II a a i|2 so ( l °g\ T n-i\\ 

(5.5) || n - || =Ol — j= j— a.s. 

\ | -U- n— 1 1 / 

In addition, we also have the quadratic strong law 

1 n 

(5.6) lim -y2\T k _ 1 \(9 k -9) t A(9 k -9) = 2(p+l)a 2 a.s. 

fe=l 

where A = I2 (8> L. 
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Our second result is devoted to the almost sure asymptotic properties of the 
variance and covariance estimators a\ and p n . Let 

1 ^ , , , . . 1 



0\, 



J2 (. £ 2k + 4k+i) and Pn = — - J2 £ 2kS2k+i- 






Theorem 5.3. Assume that (e n ) satisfies (H.l) to (H.3). Then, a 2 con- 
verges almost surely to a 2 . More precisely, 



a.s. 



a.s. 



(5.7) lim - V (e 2k - £2k) 2 + fok+i ~ ^2k+i) 2 = 2(p + l)cr 2 

n— >oo 77, £ — » 

/Cfc Ji n — l,p 

IT I 

(5.8) lim J-^Hct 2 - a 2 ) = 2(p + 1W 2 a.s. 

n — >oo 77, 

In addition, p n converges almost surely to p 

(5.9) lim - V (e 2k - £2k)(?2k+i ~ £2k+i) = ip+ l)p 

n~ »oo 77 * — ' 

rcfcl n.— l,p 

|Tr n i 

(5.10) lim —^-{p n ~ Pn) = 2(p+ l)p a.s. 

n — >oo 77 

Our third result concerns the asymptotic normality for all our estimators 
9 n , d n and p n . 

Theorem 5.4. Assume that (e n ) satisfies (H.l) to (H.5). Then, we have 
the central limit theorem 



(5.11) 


^/\T n -i\(9n -0)-±+ AA(0, r ® L- 1 ). 


In addition, 


we also have 

r> 4 n 4 i 2 


(5.12) 


V'|T„_ 1 |^-^)^AT(0,'' ~\ + " 


and 




(5.13) 


\/|T„-i|(i5„-rt -^.-VtO,!/ 2 -^). 



The rest of the paper is dedicated to the proof of our main results. We start 
by giving laws of large numbers for the noise sequence (e n ) in Section k3J 
In Section [TJ we give the proof of Proposition 5.1 Sections [8j [9] and [TU] 



are devoted to the proofs of Theorems 5.2, 5.3 and 5.4 respectively. The 
more technical proofs, including that of Theorem 5.1 are postponed to the 
Appendices. 



12 B. BERCU, B. DE SAPORTA, A. GEGOUT-PETIT 

6. Laws of large numbers for the noise sequence. We first need 
to establish strong laws of large numbers for the noise sequence (s n ). These 
results will be useful in all the sequel. We will extensively use the strong 
law of large numbers for locally square integrable real martingales given in 
Theorem 1.3.15 of [4 . 

Lemma 6.1. Assume that (e n ) satisfies (H.l) and (H.2). Then 
(6.1) lim — — • V e k = a.s. 

n^+oo | Jl n | '—f 

In addition, if (H.3) holds, we also have 



a.s. 



a.s. 



(6-2) hm -^ E 4 = ^ 2 

and 

(6-3) lim — J2 £2k£2k+i = P 

ra-*+oo T n _i hc J~^ 

Proof : On the one hand, let 

n 

Pn= J2 ^ = EE £ »' 
k£T n ,p k=pi£Gk 

We have 

AP„+l = P n +1 — Pn = 2^ £fc- 

fcSGn + 1 

Hence, it follows from (H.l) and (H.2) that (P n ) is a square integrable real 
martingale with increasing process 

n 

<P> n = (a 2 +p)J2 IGfcl = (^ + P)(l T n| - |Tp_i|). 

k=p 

Consequently, we deduce from Theorem 1.3.15 of [3] that P n = o(< P > n ) 
a.s. which implies (6.1). On the other hand, denote 

n 1 

Qn = 2_^ j^77 z^ e *' 
where e n = e 2 — a 2 . We have 



k=p \^k\ j S (g fc 



AQn+l — Qn+l — Qn — 7^ T 2_^ ejfc. 

K6bn+1 
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First of all, it follows from (H.l) that for all k £ G n +i, E[ejt| J- n ] = a.s. In 
addition, for all different k,l €. G n +i with [k/2] 7^ [1/2], 

^[ekeilfn] = a.s. 

thanks to the conditional independence given by (H.2). Furthermore, we 
readily deduce from (H.3) that 

sup sup E[ej.|.F n ] < 00 a.s. 

n>p— 1 fceGn+i 
Therefore, (Q n ) is a square integrable real martingale with increasing process 



<Q>„ < 2 sup sup E[ef|.F fe ]^ 

p— l<fc<n— 1 i£(Gfc+i 



J=P 



< 



1 



1\J 



a.s. 



2 sup sup E[ef|.Ffc] V(-) a.s. 

p-l<fe<n-liGG fc+ i j=P 



< 2 sup sup E[ef |.Ffc] < 00 a.s. 

p— l<fc<n— 1 isGfc+i 

Consequently, we obtain from the strong law of large numbers for martin- 
gales that (Q n ) converges almost surely. Finally, as (|G n |) is a positive real 
sequence which increases to infinity, we find from Lemma [A. 1 in Appendix [A] 
that 

n 

EE e * = °(i G »l) 

k=pi£Gk 
leading to 

n 

E E ci = o(|T B |) 

k=piaGj c 



a.s. 



a.s. 



as |T n | — 1 = 2|G n |, which implies (6.2). We also establish (6.3) in a similar 
way. As a matter of fact, let 

n 1 

Rn = E UT 1 E (. £ 2i e 2i+l - P)- 

k=p ' K i! i6G fc _i 

Then, (i2 n ) is a square integrable real martingale which converges almost 
surely, leading to (6.3). □ 
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Remark 6.2. Note that via Lemma \A.2\ 

n^+oo |G n | fc ^ n->+oc |G n | ^ 

In /act, eac/i new generation contains half the global available information, 
observing the whole tree T n or only generation G n is essentially the same. 

For the CLT, we will also need the convergence of higher moments of the 
driven noise (e n ). 

Lemma 6.3. Assume that (e n ) satisfies (H.l) to (H.5). Then, we have 
lim — — J2 et = r 4 a.s. 

n— >+oo Jl„ "—^ 

and 

lim | - \^ 

n-,+oo\T n _ 1 \ keJ ^ p _ i 

Proof : The proof is left to the reader as it follows essentially the same lines 
as the proof of Lemma 6.1 using the square integrable real martingales 

k=p I k ' ieG fc 

and 

Rn = ± w ^ 1 £ (44 + i-- 2 )- 
k=p\^k-l\ i£Gk _ 1 



-k 



-2 _2 .2 



e 2fc e 2fc+l — V a - S - 



Remark 6.4. Note that again via Lemma A. 2 



n ™ un~\ EI £ 2k = tA and lim — — £ 4k+i = t 4 a - s - 

7. Proof of Proposition 5.1| Proposition 5.1 is a direct application 
of the two following lemmas which provide two strong laws of large numbers 
for the sequence of random vectors (X n ). 

Lemma 7.1. Assume that (g n ) satisfies (H.l) and (H.2). Then, we have 

(7.1) lim -J- V X fc = A = a(I p - A)- 1 ^ a.s. 

n— !-+oo | Jl n | *— ^ 

Kfc il n,p 
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where a = (ao + bo)/2 and A is the mean of the companion matrices 

A= l -{A + B). 

Lemma 7.2. Assume that (e n ) satisfies (H.l) to (H.3). Then, we have 

(7.2) lim -L Y, X fc X* fc = ^ a.s. 

/^fc Jl n,p 

where the matrix I is the unique solution of the equation 

£ = T+-(A£A t + B£B t ) 

T = (a 2 + ^)eiei + ^(a (AAei + e 1 X t A t ) + 6 (#Aei + e^B 1 )) 

with a? = (ag + &q)/2. 

Proof : The proofs are given in Appendix [A] □ 



Remark 7.3. W^e shall see in Appendix A that 

^ = E^ E ere 

fc=0 Ce{A;S} fe 

where the notation {A; B} means the set of all products of A and B with 
exactly k terms. For example, we have {A; B}° = {I p }, {A; B} 1 = {A,B}, 
{A;B} 2 = {A 2 ,AB,BA,B 2 } and so on. The cardinality of {A; B} k is obvi- 
ously 2 k . 

Remark 7.4. One can observe that in the special case p = 1, 
lim — - — > Xu = = a.s. 

Btln 

1 v^ ^2 ~aJ + a 2 + 2Xab 
lim — —r > Al = = a.s. 



where 



—r _ QqQi + frpfri g _ oi + 6j p- _ of + fef 

2 " 2 ' 2 



1G 
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8. Proof of Theorems 5.1 and 5.2 Theorem 5.2 



is a consequence 

of Theorem 5.1 The first result of Theorem 5.1 is a strong law of large 
numbers for the martingale (M n ). We already mentioned that the standard 
strong law is useless here. This is due to the fact that the dimension of 
the random vector £ n grows exponentially fast as 2 n . Consequently, we are 
led to propose a new strong law of large numbers for (M n ), adapted to our 
framework. 



Proof of result (5.2) of Theorem 5.1 : For all n > p, let V n = M*E~AiM n 
where we recall that S n = I2 <8> S n , so that X" 1 = I2 S' 1 . First of all, we 
have 

V n +i = M t n+1 Z- 1 M n+1 = (M n + AMn+ifE^iMn + AM n+ i), 
= M t n Y,- 1 M n + 2M*S; 1 AM n+1 + AM^S^AM^, 
= V n -M*(S^ 1 -S^ 1 )M n +2M*S- 1 AM n+1 +AM^ +1 S; 1 AM„ +1 . 

By summing over this identity, we obtain the main decomposition 

(8.1) Vn+l + An = V p + B n+1 + Wn+1, 

where 

n 

k=p 

n 

B n+l = 2 J^ Ml^AM^ and W n+1 

k=p k=p 



^AM* +1 S^AM fc+1 . 



The asymptotic behavior of the left-hand side of (8.1) is as follows. 
Lemma 8.1 Assume that (e n ) satisfies (H.l) to (H.3). Then, we have 



J.2) 



lim 



II 



(p+iK 



a.s. 



Proof : The proof is given in Appendix B. It relies on the Riccation equa- 
tion associated to (S n ) and the strong law of large numbers for (W n ). □ 

Since (V n ) and (An) are two sequences of positive real numbers, we infer 
from Lemma 8.1 that V n +i = 0(n) a.s. which ends the proof of (5.2). □ 

Proof of result (5.5 ) of Theorem 5.2[ It clearly follows from (4.1 ) that 

V n = (6 n — 0) T, n -l(9n ~ 0). 
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Consequently, the asymptotic behavior of 6 n — 6 is clearly related to the one 
of V n . More precisely, we can deduce from convergence (5.1) that 



lim 

n^oo nrv 



Amin(A) > a.s. 



since L as well as A = I2 <S> L are definite positive matrices. Here A m i n (A) 
stands for the smallest eigenvalue of the matrix A. Therefore, as 



< 



V n 



we use (5.2) to conclude that 

\\9 n -e\\ 2 = o 



n 



T 



n-l\ 



AminV^n-l) 

log|T n _i| 



O 



IT 



n-l\ 



a.s. 



which completes the proof of (5.5). 



□ 



We now turn to the proof of the quadratic strong law. To this end, we 
need a sharper estimate of the asymptotic behavior of (V n ). 

Lemma 8.2 Assume that (e n ) satisfies (H.l) to (H.3). Then, we have for 
all 5 > 1/2, 



1.3) 



M n || 2 = (|T n _ 1 |n <5 ) 



a.s. 



Proof : The proof is given in Appendix C. 



□ 



A direct application of Lemma 8.2 ensures that V n = o(n ) a.s. for all 
5 > 1/2. Hence, Lemma 8.1 immediately leads to the following result. 

Corollary 8.3 Assume that (e n ) satisfies (H.l) to (H.3). Then, we have 



(8.4) 



lim 

n— >+oo n 



(p+iy 



a.s. 



Proof of result (5.3) of Theorem 5.1 First of all, A n may be rewritten 
as 

n n 

k=p k=p 



where A n = l2(p+i) — ^n-i^n 1 ^?/-!- ^ n addition, via Proposition 



5.1 



1.5) 



lim - — 

n— >oo nrv 



A 



a.s. 
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which implies that 



J.6) 



lim A r 



I 



2(P+1) 



a.s. 



Furthermore, it follows from Corollary 8.3 that A n = 0(n) a.s. Hence, we 



deduce from (|8.5|) and (|8.6|) that 
(8.7) 



n 



1 



2n 



^M*S^M fe +o(l) 



k=p 



and convergence (5.3) directly follows from Corollary 8.3 



□ 



We are now in position to prove the QSL. 



Pr oof of result (5.6) of Theorem 5.2 The QSL is a direct consequence 



-i 



of (5.3) together with the fact that 9 n — 6 = S n _ 1 M n . Indeed, we have 



1 n 1 n - 



n , — ' n , 

fe=p k=p 



-lWk 



11 



11 



Ei T fc-il(^ 



k=p 



a s fc-i 

J IT 



k-i 



9*-fl) 



EI |T fc _i|(e fc - ^)*A(4 - ^) + o(l) a.s. 



k=p 



which completes the proof of Theorem 5.2 



□ 



9. Proof of Theorem 5.3 . The almost sure convergence of <7„ and p n 



is strongly related to that of V n — V n . 



Proof of result (5.7) of Theorem 5.3 We need to prove that 



(9.1) 



1 



lim- V \\V k -V k \\ 2 = 2(p+l)a 2 a.s. 



fceT 



n — l,p — 1 



Once again, we are searching for a link between the sum of \\V n — V n \\ and 
the processes (An) and (V„) whose convergence properties were previously 
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investigated. For all n > p, we have 



E \\Vk-V k \f 

fce<G n 



/ , i^2k — £2fc) + (£2k+l — £2k+l) , 

(e n -6y* n ¥ n (e n -e), 

M*E;y i 2 A n E;l / 1 2 M n , 



where 



-V2 lTf lT ,t v -l/2 _ v-l/2 



An = X-- , l*nKK- / l = K-'l^n ~ ^n-l)^! 



-1/2 



Now, we can deduce from convergence (8.5) that 



lim An = I 



n — i 2(p+l) 



a.s. 



which implies that 



fcSGn 



a.s. 



Therefore, we can conclude via convergence (5.3) that 

1 - 1 n 

lim- E Wk-V k f= lim -E M t k ^ 1 M k = 2(p+l)a s 

fceT n _i iP _i k=p 



Proof of result (5.8) of Theorem 5.3 First of all, 

1 

2|T n _i| 



•~2 2 



E (M 2 -H^ 



fcfcl n — l,p- 



1 



2IT 



n-1 



E (ll^fe — Vfc]| 2 + 2(V3fe — Vfc)*Vfc). 



fceT n _i iP _i 



Set 



P n = E (Yk-v k ) t v k = ^2 E (Yi-vtfVi. 

fceT n _i iP _i fc=pieG fe _i 

We clearly have 

AP n+ i = P n+1 -P n = E (^ " ^)*Vfc. 

fceG n 



19 



a.s. 
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One can observe that for all k £ G n , V k — Vk = (I2 <8> Yk) {0 — On) which 
implies that Vk — Vk is .^-measurable. Consequently, (P n ) is a real martingale 
transform. Hence, we can deduce from the strong law of large numbers for 



martingale transforms given in Theorem 1.3.24 of [1] together with (9.1) 
that 

Pn = o( Y, \\Vk ~ V k )\\ 2 \ = o(n) a.s. 

It ensures once again via convergence ( |9.1[ ) that 
lim 1M( ? 2 _ ff 2) = lim I j- \\V k -V k f = 2(p + l)a 2 a.s. 

fe£T„_i iP _i 

We now turn to the study of the covariance estimator p n . We have 

Pn~ Pn = 7^, r 2^ (e2fce2fc+l _ ^2k^2k+l), 

feei„_i iP _i 

= T^ 1 Z_v ^ 2k ~ £ 2k)(^2k+l - £2fc+l) + 7^, \Qn, 

where 

Qn = 2^ (£2fc — £2£i) e 2fc+l + (£2fc+l ~ £2k+l)t2k = 2_^ (Vfc — Vfc) ^Vfc 

fceTr n _i iP _i feeT n _i jP _i 

with 

Moreover, one can observe that J2rJ2 = T. Hence, as before, (Q n ) is a real 
martingale transform satisfying 

Qn = o( Yl \\Vk-V k )\\ 2 \=o(n) a.s. 

\fceT„_i, p _i / 

We will see in Appendix [D] that 

(9.2) lim- V (e2k-£2k)(s 2 k+i- £2k+i) = (p + l)p a.s. 

fceT n _i,j,_i 



Finally, we find from (9.2) that 



lim —^{pn - Pn) = 2(p + l)p a.s. 

n— >oo 72 

which completes the proof of Theorem |5.3[ □ 
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10. Proof of Theorem 5.4 In order to prove the CLT for the BAR(p) 
estimators, we will use the central limit theorem for martingale difference 
sequences given in Propositions 7.8 and 7.9 of Hamilton |H]. 

Proposition 10.1 Assume that (W n ) is a vector martingale difference se- 
quence satisfying 

(a) For all n>l, E,[W n W n ] = £l n where £l n is a positive definite matrix and 

1 n 
lim — } S7fc = S7 

n— >00 71 ^— ' 

k=l 

where S7 is also a positive definite matrix. 

(b) For all n > 1 and for all i,j, k, I, ¥,[Wi n Wj n Wk n Wi n ] < oo where Wi n 
is the ith element of the vector W n . 

(c) 

1 n T> 

- E w * W t -^ o. 

Then, we have the central limit theorem 

We wish to point out that for BAR(p) processes, it seems impossible to 
make use of the standard CLT for martingales. This is due to the fact that 
Lindeberg's condition is not satisfied in our framework. Moreover, as the size 
of (£ n ) doubles at each generation, it is also impossible to check condition 
(c). To overcome this problem, we simply change the filtration. Instead of 
using the generation-wise filtration, we will use the sister pair-wise one. Let 

Q n = o-{Xi, (X 2 k,X 2 k+i), l<k<n} 

be the cr-algebra generated by all pairs of individuals up to the offspring of 
individual n. Hence (s2n,£2n+i) is £/ n -measurable. Note that Q n is also the 
cr-algebra generated by, on the one hand, all the past generations up to that 
of individual n, i.e. the r„th generation, and, on the other hand, all pairs of 
the {r n + l)th generation with ancestors less than or equal to n. In short, 

Q n = a[T Tn U{(X 2 k,X 2 k+i), k G G rn , k <n}j. 

Therefore, (H.2) implies that the processes (e 2n ,X n e 2n ,e 2n+ i,'K n e 2n+ i) t , 
( £ 2n + £ 2n+i ~ 2o " 2 ) anci { £ 2n£2n+i - p) are (5 n -martingales. 



22 
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Proof of result (5.4) of Theorem 



5.1 



First, recall that Y n 



(l,Xn)*. 

We apply Propositions 10.1 to the <5 n -martingale difference sequence (D n ) 
given by 

X n £2n 

&2n+l 



D n = vec(Y n V r 



\ ^n£2n+l / 



We clearly have 



DnD l n 



^2n £2n£2n+l 

2 
£2n+l£2ra ^2n+l 



Yni n - 



Hence, it follows from (H.l) and (H.2) that 

E[D n D t n ] = r®E[Y n Yt}. 



Moreover, we can show by a slight change in the proof of Lemmas 7.1 and 
El that 



lim 



. ,J-T E nD k D{] = r ® hm i^-rE[5„] = r ® L, 



which is positive definite, so that condition (a) holds. Condition (6) also 
clearly holds under (H.3). We now turn to condition (c). We have 



E 

keT„_i . 



Afetffc 



r ® 5 n + i^ 



where 



^?n 



E 

fceT n _i iP _i 



2 2 

£ 2fc ~~ °" £2fc£2fc+l — P 

£2k+l£2k - P £ 2 k+l ~ a 



® nifc 



Under (H.l) to (H.5), we can show that (R n ) is a martingale transform. 



Moreover, we can prove that R n = o{n) a.s. using Lemma A. 6 and similar 
calculations as in Appendix B where a more complicated martingale trans- 
form (K n ) is studied. Consequently, condition (c) also holds and we can 
conclude that 



(10.1) 



v^v 



E D k 



i 



fceT 



n — l,p — 1 



VW^- 



Mr, 



c 



M(0, r (8) L). 
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Proof of result (|5.11[) of Theorem 5.4 We deduce from (4.1 1 that 



Tn-l|(#n — 0) — |T n _l|S n _ 1 



M„ 



vw 



n-l\ 



Hence, (5.11) directly follows from (5.4) and convergence (8.5) together with 
Slutsky's Lemma. □ 



Proof of results (5.12) and (5.13) of Theorem 5.4 On the one hand, 
we apply Propositions 10.1 to the C? n -martingale difference sequence (v n ) 
defined by 

v n = ^2n + e 2n+l ~~ ^° • 

Under (H.4), one has Ekv^] = 2r 4 — 4<r 4 + 2v 2 which ensures that 
1 



lim 

n— >oo Xr 



53 E bfc] = 2 ^ 4 - 4 ^ 4 + 2 ^ 2 > 0. 



KG ii-n,p— 1 

Hence, condition (a) holds. Once again, condition (6) clearly holds under 
(H.5), and Lemma 6.3 together with Remark 6.4 imply condition (c), 

1 



lim 



&£ W n,p— 1 

Therefore, we obtain that 
1 



53 v\ = 2r 4 - 4a 4 + 2z^ 2 a.s. 



(10.2) 



VP 



n-\\ 



c 



53 Ufe = 2J|T n _ 1 |(^-a 2 )^^(0,2r 4 -4a 4 +2^). 



fceT 



n — l,p — 1 



Furthermore, we infer from (5.8) that 
(10.3) lim J\T n ^\(a 2 n -al) 







a.s. 



Finally, (10.2) and (10.3) imply (5.12). On the other hand, we apply again 
Proposition 10.1 to the C?„-martingale difference sequence (w n ) given by 

W n = £2n^2n+l ~ P- 

Under (H.4), one has Efw 2 ] = v 2 — p 2 which implies that condition (a) holds 
since 



lim 



1 



n^oo X 



53 E[w 2 k ] = v 2 -p 2 >0. 



KG Jln,p-1 
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Once again, condition (b) clearly holds under (H.5), and Lemmas 6.1 and 



6.3 yield condition (c), 



lim — — r y^ Wj. = v — p 

1 n| fceT„ 



a.s. 



1 n,p — 1 



Consequently, we obtain that 
1 



(10.4) 



v^T^ 



£ 



£ w k = ^\T n ^ 1 \(p n -p)-^M(0,u 2 -p 2 ). 

fegT n _i „_ i 



Furthermore, we infer from (|5.10|) that 
(10.5) 



lim J|T n _i|(p n - p n ) = a.s. 



Finally, (5.13) follows from (10.4) and (10.5) which completes the proof of 

□ 



Theorem 15.41 



APPENDIX A 

Laws of large numbers for the BAR process 

We start with some technical Lemmas we make repeatedly use of, the 
well-known Kronecker's Lemma given in Lemma 1.3.14 of [1] together with 
some related results. 

Lemma A.l. Let (a n ) be a sequence of positive real numbers increasing to 
infinity. In addition, let (x n ) be a sequence of real numbers such that 



n=0 



Then, one has 



lim 



< +oo. 



£ Xk = 0. 

fc=0 



Lemma A. 2. Let (x n ) be a sequence of real numbers. Then, 



(A.l) lim - r V x k 



fceT n 



lim 

n— >oo 



£ X h 



X. 



" n| fce<G„ 



ASYMPTOTIC ANALYSIS FOR BAR PROCESSES 25 

Proof: First of all, recall that |T„| = 2 n+1 - 1 and |G n | = 2 n . Assume that 

lim — — • V x k = x. 

n— >oo T 

1 n| k£T n 

We have the decomposition, 

E Xfc = ^2 x k+ ^2 x k . 

fceT n fceT„_i k£G„ 

Consequently, 

1 v-^ .. 2 v-^ , 1 



, , E ** = lim ^tzt E **- lim i T Vn E **, 



lim 

2x — x = x. 



Conversely, suppose that 



™ l G «l fclG B 



A direct application of Toeplitz Lemma given in Lemma 2.2.13 of [3]) yields 

1 v^ 1 x^ 



T^T E 1 * = lim Kn^T E E Xi ' 



lim 

nr i 

fceT„ '""' fc=0ieG fe 

1 n 1 

lim Wl^^url E x * = x - 
i ™i fc=o ' K| ieG fc 



Lemma A. 3. Let (A n ) be a sequence of real-valued matrices such that 
J^^Lo IIAiH < °° and 

n 

lim J2A k = A. 

fc=0 

In addition, let (X n ) be a sequence of real-valued vectors which converges to 
a limiting value X. Then, 



(A.2) lim V A n „ k X k = AX. 

fc=0 

Proof: For all n > 0, let 

n 

U n = 2_^ A n ^ k X k . 

fc=0 
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We clearly have for all integer no with 1 < no < n, 

n n oo 

\\U n -AX\\ = \Y,A n - k X k -Y,MX- ]T A k X 

k=0 k=0 k=n+l 

n oo 

< J2W A n-k\\\\Xk-x\\+ J2 \\M\\x\\, 

<Y2\\A n _ k \\\\X k -X\\+ Yl W A n-k\\\\X k - X\\ + J2 Pfellll^ll- 

fc=0 fc=no+l k=n+l 

We assume that {X n ) converges to a limiting value X. Consequently, we can 
choose no such that for all k > uq, \\X k — X\\ < e. Moreover, one can find 
M > such that for all k > 0, \\X k - X\\ < M and ||X|| < M. Therefore, 
we obtain that 

n oo 

\\U n -AX\\<(n + l)Msup\\A k \\+e ^ ||A n _ fc ||+M^ ||A fc ||. 

k>n-n fc=n„+l k=n+l 

On the one hand 

oo 

sup \\A k \\ and ^ \\ A k\\ 

k>n-n k =n+l 

both converge to as n tends to infinity. On the other hand, 

n oo 

E l|Ai-fc|| < E \\A n \\ < OO. 
fc=no+l n=0 

Consequently, || t/ ra — AX\\ goes to as n goes to infinity, as expected. □ 



Lemma A.4. Let (T n ) be a convergent sequence of real-valued matrices with 
limiting value T. Then, 

n , 

lim E ^ E CT n _ fe C* = £ 

k=0 C&{A;B} k 

where the matrix 

OO -i 

^ = E^ E crc 

fc=o cejAjS}* 
is the unique solution of the equation 

(A.3) £ = T + - (AM* + B«B*) . 
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Proof: First of all, recall that = max{||A||, \\B\\} < 1. The cardinality of 
{A; B} is obviously 2 . Consequently, if 

U n = E 4 E C ( T -^ " T ) Ct ' 



k=0 Ce{A;B}* 



it is not hard to see that 



i^n<Ei>< 2 ^ 2fc 



fc=0 



[ n-fc 



E/3 

fc=0 



2(n-k) 



n-r 



Hence, (U n ) converges to zero which completes the proof of Lemma A. 4 □ 

We now return to the BAR process. We first need an estimate of the sum 
of the ||X n || 2 before being able to investigate the limits. 

Lemma A. 5. Assume that (e n ) satisfies (H.l) to (H.3). Then, we have 



(A.4) 



E ii x *i 



0(\T r . 



a.s. 



Proof : In all the sequel, for all n > 2 P 1 , denote Ai n = A and A<m+\ = B. 
It follows from a recursive application of relation (2.2 ) that for all n > 2 P ~ 1 

r n -p 



(A.S) 



X, 



(114 



fc=0 



r n —p fc-1 



X, 



l 2 r n _ P+ 



T ]+ e (n^%i)^] 



k=0 i=0 



with the convention that an empty product equals 1. Then, we can deduce 
from Cauchy-Schwarz inequality that for all n > 2 P ~ 1 



Tn-P 



fc=0 



l 2 r " _ P+ 1 - 



r n —p fe— 1 

E(n^ 

fc=0 i=0 



[SlM*] 



< 



J"'7 " ' L 2 fc J 
2 



E(nn^]ii)N 

\ fc=0 i=0 
/r n -p 

* E^ll^]ll) 

An —p \ fr n -p 

< (e^j(e^ 

n—p 



fc=0 / \ fc=0 
Tn — p 



< 



1 



1-/9 



. fc=0 



fe||„ II 2 

2fc J " 
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Hence, we obtain that for all n >2 P , 



r n -p 



r n -p 



^-(n^ifei+di^ 



< 



1-/3 



fc=0 
fr n —p 

Vfc=0 



+ 2/?' 



fc=0 



2(r„-p+l)i 



2 r n — P+l - 



l 2 r "~P+ 1 J 



Denote a = max{|ao|, |&o|} an d -X"i = max{||X&||, A; < 2 P 1 }. Summing up 
over the sub-tree T ntP , we find that 



E 11**1 



'rk-p 



^.?r I>%iii 2 + ? 2 " 



2(r fc -p+l)| 



4 



4=0 

Pfe— P 



keT». 



2 r fe-P+ 1J 



< T^g E E /*V + *[£])+ E 2/3 a ^-^ 1 )[|X [ _i 

r£ fc -U- n p * — U K t -U- ri ,p 

A r *-P A a 1 r *-P 



p+u 



(A.6) 
where 



< 



+2X1 2 E /3 2(rfc ~ p+1) , 

Kfc il 71, p 

1-/31-/3 x ' 



Tk-P 



1-k-P 



Pn= E E/^ai, Qn= E E^ fl»= E/ 3 



2{r k -p+l) 



keT ri 



The last two terms of (A.6) are readily evaluated by splitting the sums 
generation- wise. As a matter of fact, 

n i _ ah -■ n 

(A-7) Q n = EE ^ < 7 I3 ^ E 2" = 0(|T B |), 

k=pi€G k f K ' ' k=p 

and 

n n 

(a.8) R n = e E z 3 ^ 1 < E( 2 /3) fe = °(i T ni)- 

k=p isGjs fc=p 

It remains to control the first term P n . One can observe that e^ appears in 
P n as many times as it has descendants up to the nth generation, and its 
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multiplicative factor for its ith generation descendant is (2/3)*. Hence, one 
has 



n-r k 



Pn= E EW4 

fcST„, p i=0 

The evaluation of P n depends on the value of < j3 < 1. On the one hand, 
if (3 = 1/2, P n reduces to 



Pn = J2 ( n + 1 ~ r k) £ t = E( n + l - k ) E £ 



Hence, 



fceT„ 



P, 



k=p 



ieGfe 



IT I -J- 1 ' ' \ On+1— fc 

IM + 1 k=p \ - 



(n + l-k)\ 1 



However, it follows from Remark 6.2 that 

1 



lim 



In addition, we also have 



E,-2 Jl 

e k = a 



E 



a.s. 



fceG,-, 



" k 
lim V -r = 2. 



n— >oo ^— ' 9 
fe=l 



Consequently, we infer from Lemma |A.3 that 

,2 



(A.9) 



lim 



P, 



n— >+oo T n 

On the other hand, if /3 ^ 1/2, we have 



2^ 



a.s. 



1 - (2fl"--»+i _ 1 » 



n— Ai+1\ 



E 



fi?. 



Thus, 



P 



Furthermore, 



TJ + 1 ~ 1-2/3 A' 



" fc=p 



1 s n-fc+1 



/3' 



n-fc+1 



|G fc | 



E 



jfcdjfc 



n-oo 1-2/3 ^ \\2/ M ) 1- 



/r 



.so 



B. BERCU, B. DE SAPORTA, A. GEGOUT-PETIT 



As before, we deduce from Lemma A. 3 that 

'2 



(A.10) 



lim — — 

n— >+oo T n 



a 



1-/3 



a.s. 



Finally, Lemma A. 5 follows from the conjunction of (A. 6), (A. 7), (A. 8) to- 
gether with (IA.9I) and (IA.101). □ 



Proof of Lemma 7.1| : First of all, denote 



H„ 



E 



and 



Kc Jl- n,p— 1 



P n = E £fc ' 



As |T n | = 2 n+ — 1, we obtain from Equation (2.2) the recursive relation 



(A.ll) 



= F p _! + 2AH n ^ + 25(2 n - 2 p ~ 1 )e 1 + P n e x 



where e\ = (1, 0, . . . , 0) € K p , a = (ao + 6o)/2 and the matrix 

-r -4 + 5 



By induction, we deduce from (A.ll) that 



2 n+1 



H v -\ -,H n -i /2 n -2P-\ P r 



pnn-p+i-flp 



on / x ' On+1 

n ( U ,ok op— 1 



1 + E(^r fc ifer+K- 



2 p ■ ^\- / i 2 fc+i V 2 fe 

fc=p \ 



ft 

e i + 7nrrr e i 



2 fc+r 



We have already seen via convergence (6.1) of Lemma 6.1 that 

Pn 



lim , . 

n-»+oo 2 n+1 







a.s. 



Finally, as \\A\\ < 1, 

oo oo 

^ii(3ni<oo and (ip-Ay^j^^r, 



n=0 



ra=0 



it follows from Lemma lA.31 that 



lim 

n->oo 2 n+1 



a(I p — -4) ei a.s. 
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which ends the proof of Lemma 7. 1 
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□ 



Proof of Lemma 7.2 : We shall proceed as in the proof of Lemma 7.1 and 
use the same notation. Let 



KG jL n,p — 1 



IfcX fc 



and L n = E £ l- 

KG 1L n,p 



We infer again from (2.2) that 



K n = Kp^i + E (^fe x [i] + Vk) (^.fcXjfc] + r?fcj 

KG JL 7j, ? p 

KG Jl. n,p KG Jl-rt — ljp — 1 



+ E ((°o + e 2k )^k{A) + (b + e 2k +i)^k{B) + 2(a 2 + C2fc)eie* 1 

where U fc (A) = AX^ + eiX^* and U fc (S) = BXfcei + eiX^B*. In addition, 
a 2 = (ag + 6q)/2 and ^2fc = («o^2fc + ^o£2fc+i)- Therefore, we obtain that 



(A.12) 
where 

T n ■- 



2«+i 2 V 2 n 2 n 



^+T+ a ( Vn J + ^T E C 2 fc|ei 



2" 



Bl 



fcST n _i, p _i 



+ 



1 ( ( ,H n -l t , #n-l .A . , /n-ffn-l t . 



2 n 



on+l 



E (e 2 feU fe (^)+e 2fc+1 U fc (5) 



fceT n _i iP _i 



The two first results (6.1 ) and (6.2 ) of Lemma 6.1 together with Remark 6.2 
and Lemma A. 2 readily imply that 

L 



i ■ —n 2 

lim — — - = a a.s. 

n^+oo 2 n+1 



and 



1 



H5L^ £ ^ = 



++OO 2 



a.s. 



KG 11 n — l,p- 
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In addition, Lemma 7.1 
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gives 



lim = A 

n— »+oo 2 n 



a.s. 



Furthermore, denote 

U n = 



J2 {e 2k V k {A)+e2 k+ i^k{B)). 

fcGT n _i p_i 



For all u £W, let U n (u) = u l U n u. The sequence (U n (u)) is a real martingale 
transform. Moreover, it follows from Lemma A.5| that 

J2 |«*U*(A)u| + |u'Ujfe(.B)u| = £>(|T n |) a.s. 

fceT„_i iP _i 

Consequently, we deduce from the strong law of large numbers for martingale 
transforms given in Theorem 1.3.24 of [4] that U n {u) = o(|T n |) a.s. for all 
u G W which leads to U n = o(|T n |) a.s. Therefore, we obtain that (T n ) 
converges a.s. to T given by 

T = (a 2 + a?)eie{ + - ^A\a e\ + a eiA',4' + B\b e{ + b e 1 X t B t '\ . 



Finally, iteration of the recursive relation (A. 12) yields 
K n 



1 



9«+l 'yn—p+l 



n—p 



E 



c 



C£{A;B} n -P+ 1 



2 p '^.2 



1 



k=0 C&{A;B} k 



On the one hand, the first term on the right-hand side converges a.s. to zero 
as its norm is bounded f3 2 ( n ~ p+1 >\\K p -i\\/2 p . On the other hand, thanks to 
Lemma A. 4 the second term on the right-hand side converges to £ given by 
(A. 3), which completes the proof of Lemma 7.2 . □ 



We now state a convergence result for the sum of 
useful for the CLT. 



I 4 which will be 



Lemma A. 6. Assume that (e n ) satisfies (H.l) to (H.5). Then, we have 
(A.13) V ||X fc || 4 = 0(|T n |) 



E Ii a ^ 

rCfc JL n,p 



a.s. 
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Proof : The proof is almost exactly the same as that of Lemma A. 5 Instead 

64q 4 Q, 



of Equation (A.6), we have 



E 



< 



64P„ 



+ 



(1-/3)3 (1-/3)3 



+ 8X 1 R n 



where 



Vk~P 



rk~P 



Pn= E E^ 



V 4 



Vn 



Y, E^> R n= Y,^ {rk ~ p+1) 

ftfc il n.p 



We already saw that Q n = C(|T„|). In addition, it is not hard to see that 
R n = 0(|T n |). Therefore, we only need a sharper estimate for u n . Via the 



same lines as in the proof of Lemma A.5| together with the sharper results 



of Lemma 6.3 we can show that P n = C(|T n |) a.s. which leads to (A. 13). □ 



APPENDIX B 

On the quadratic strong law 

We start with an auxiliary lemma closely related to the Riccation Equation 
for the inverse of the matrix S n . 

Lemma B.l Let h n and l n be the two following symmetric square matrices 
of order 5 n 

h n = QiS' 1 ^ and l n = ^S'l^n. 

Then, the inverse of S n may be recursively calculated as 

(B.l) S~ = S~_! - Sn-i*n(I<J n + l n )~ <& n S~_ x . 

In addition, we also have (\-s n — h n )(I$ n + l n ) = ls n . 

Remark B.2. If f n = 4'^S~ 1 ^' n , it follows from Lemma 

(B.2) S- 1 = E"^ - K-l*n(h5 n ~ fn)KK-V 



B.l 



that 



Proof : As S n = S^i— l + &n^ n i relation (B.l) immediately follows from 



Riccati Equation given e.g. in (J] page 96. By multiplying both side of (B.l ) 
by <£ n , we obtain 



S'^n 



S-l^n-S-i^ n (I Sn + l n )-X, 

S'l^n - S~^ n (l Sn + l n )-\l Sn +ln~ K), 

S- l _^ n {l &n +l n )- 1 . 
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Consequently, multiplying this time on the left by <£^, we obtain that 

h n = InO-Sn + ln)~ = (In + I<5 n ~ I«5„)(I(J„ + ^n)~ , 
= l S n -(h n +ln)~ 

leading to (Lj n - h n )(l Sn + l n ) = Lj„. □ 

In order to establish the quadratic strong law for (M n ), we are going to 
study separately the asymptotic behaviour of (W n ) and (B n ) which appear 
in the main decomposition ( |8.1| ). 

Lemma B.3 Assume that (e n ) satisfies (H.l) to (H.3). Then, we have 
(B.3) lim -W n = 2cj 2 a.s. 

n— >+oo n 

Proof : First of all, we have the decomposition W n -f 1 = T n +i + Tln+i where 

_ " AMJ +1 A- l AM k+1 
+1 ~ ^ iTfcl 

k=p ' K ' 

„ ^ AM* +1 (|T fc |Sfc 1 -A- 1 )AM fc+1 

We claim that 

lim — T n = (p+l)o~ a.s. 



It will ensure via (8.5) that lZ n = o(n) a.s. leading to (B.3). One can observe 
that T n+1 = trtA^^Hn+xA- 1 / 2 ) where 

" AM k+1 AMJ +1 

n+1 ~P — Wk\ — • 

k=p ' K ' 

Our goal is to make use of the strong law of large numbers for martingale 
transforms, so we start by adding and subtracting a term involving the con- 
ditional expectation of AH n +i given J- n . We have already seen in Section H] 
that for all n > p- 1, E[AM n+ iAM* +1 |.F n ] =T® $n$^- Consequently, we 
can split i? n +i into two terms 

H n+ i = \] — — h K n+ i 

7 — 1*! 

k=p I K I 



where 

Kn+l = 

k=p 



"AM k+1 AMl +1 -r®$ k <f>l 

n+1 = ^ m ' 
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On the one hand, it follows from convergence (5.1) and Lemma A. 2 that 



lim 
Thus, Cesaro convergence yields 



1 



-L 



a.s. 



(B.4) 



hm — > — — — — - = -(T<S)L) 

k=p ' K ' 



a.s. 



On the other hand, the sequence (K n ) is obviously a matrix martingale 
transform satisfying 



AK, 



n+l 



K, 



n+l 



Kr, 



1 

|Tn+l 






1 



where 



£2i£2j — ^i=j<? ^2i^2j+l — $-i=jP 

£2i+\£2j — $-i=jP ^2i+1^2j+l — ~S-i=j<? 



For all u £ M 2 ' p+1 ), let K n (u) = u l K n u. It follows from tedious but straight- 



forward calculations, together with (A. 4), (A. 13) and the strong law of 



large numbers for martingale transforms given in Theorem 1.3.24 of [4 J that 
K n (u) = o(n) a.s. for all u 6 M. 2 ( p+1 > leading to K n = o(n) a.s. Hence, we 



infer from (B.4) that 
(B.5) 



lim —H n 

n— »+oc n 



1 



(r®L) 



a.s. 



Finally, we find from (B.5) that 



lim_-T n = ~tr(A-V 2 (r®L)A-V 2 ) 

= -tr((T ® L)A~ l ) a.s. 



n^+oo n 



-tr(T <8> I 



•p+U 



(p+l)a 2 



a.s. 



a.s. 



which completes the proof of Lemma B.3 



□ 



Lemma B.4 Assume that (e n ) satisfies (H.l) to (H.3). Then, we have 

B n +i = o(n) a.s. 
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Proof : Recall that 

n n 

B n+1 = 2 J2 M'E^AMfc+x = 2 £ AfjJS^^fc+i- 

fc=p fe=p 

The sequence (23 n ) is a real martingale transform satisfying 

AB n+1 = B n+1 -B n = 2M&- 1 * n £ n+1 . 

Consequently, via the strong law of large numbers for martingale transforms 
[3], we find that either (B n ) converges a.s. or B n +i = o(v n ) a.s. where 



^M^^S^Mfc. 



k=p 



However, for all n > 2 P 1 , ^ n ^n = I2 ® ^n^n which implies that 

n n 

fc=p fc=p 



Furthermore, it follows from Lemma B.l that 

as the matrix Z n is definite positive. Therefore, we obtain that 



k=p 



Finally, we deduce from the main decomposition (8.1) that 

V n+ i + An = o{A n ) + 0{n) a.s. 

leading to V n +\ = 0{n) and A n = 0{n) a.s. as V n +i and ,/4. n are non- 
negative, which implies in turn that B n = o{n) a.s. completing the proof of 
Lemma IB.4I □ 

Proof of Lemma 8.1| : Convergence (8.2) immediately follows from (8.1) 
together with Lemmas [BT3 and B.4 □ 
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APPENDIX C 
On Wei's Lemma 



In order to prove (8.3), we shall apply Wei's Lemma given in [13] page 1672, 
to each entry of the vector-valued martingale 



Mn = E E 

fc=pieG fc _i 



( £2i \ 

£2i+l 



We shall only carry out the proof for the first (p+ 1) of M n inasmuch as the 
proof for the (p + 1) last components follows exactly the same lines. Denote 



Pn ~ E Yl £2i 



and Q n = E E X * £ 2i- 

fc=pisGj ! _i 



On the one hand, P n can be rewritten as P n = E V I^A-l| u fe where 

k=p 



1 



V^ 



J n-1\ 



E £ 2i- 



!fcb„-l 

We clearly have Ef^+il^] = 0, Eju^-J^i] = a 2 a.s. Moreover, it follows 
from (H.l) to (H.3) together with Cauchy-Schwarz inequality that 

E^+ii^n] = F ^E E [4l^] + J^EE E [4l^]E[4i^ n ] 

1^™! i6G„ \^n\ ieGnj ^ 

< 3 sup E^il^n] a.s. 
ieG n 

which implies that supE[u^ +1 |^„] < +oo a.s. Consequently, we deduce from 
Wei's Lemma that for all S > 1/2, 

P n 2 = (|T n _!|n 5 ) a.s. 



On the other hand, we also have Q n = E \/\^k—i\ w k where 

k=p 



1 



UK, 



VW^- 



2 , ~^i £ 2i- 



ieG n - 



:-i,x 
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It is not hard to see that E['u; Tl _|_i|.7 r n ] = a.s. Moreover, for all 1 < k < p, 
let w n (k) be the fcth coordinate of the vector w n . It follows from (H.l) to 
(H.3) and Cauchy-Schwarz inequality that for all 1 < k < p, 



iGG„ 



< 3supE[4|.F n ] 



2 



ofc-l J Ufe-l) 



-E *fU 



a.s. 



H<=Gn 



Hence, we obtain from Lemma 7.2 that for all 1 < k < p, supK[w n +i(k) \J- n ] < 



+oo a.s. Once again, we deduce from Wei's Lemma applied to each compo- 
nent of Q n that for all 5 > 1/2, 



\Q n \\ 2 = o(\T n -i\n s ) a.s. 



which completes the proof of (8.3). 



□ 



APPENDIX D 
On the convergence of the covariance estimator 

It remains to prove that 



lim - Y^ (^2fc - £2k)(£2k+i ~ £2fc+i) = Jim, ttt = (P + l )P 



n— >oo 77 



where 



fceT n _i,p_i 



Rn 

n-»oc 2n 



Rn= E (Vk-V k )%(V k -V k ). 

fceT n _i iP _i 



a.s. 



It is not possible to make use of the previous convergence (9.1 ) because the 
matrix 

is not positive definite. Hence, it is necessary to rewrite our proofs. Denote 

K = M*S^( 2 (J 2 <g> I p+1 )^{ 2 M n . 



As in the proof of Theorem 5.2 we have the decomposition 
(D.l) V' n+ i +A' n = V[ + B' n+1 + W n+1 
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where 



A' n = Y. M l^®( S k-i-S^))M k , 

k=p 
n 

B' n+1 = 2^M*(J 2 ®5 fc " 1 )AM fc+1 , 

k=p 
n 

W n+1 = "£AMl +1 (h®S^)AM k+1 . 

k=p 

First of all, via the same lines as in Appendix B, we obtain that 



lim -W' n 

n—>+oo n 



ltr((h ® L _1 ) 1/2 (r ® L)(J 2 ® L- 1 ) 1 / 2 



a.s. 



tr(rJ 2 <8> Ip+i) = (p + l)p a.s. 



Next, (iS^) is a real martingale transform satisfying B' n+1 = o{n) a.s. Hence, 
we find the analogous of convergence (8.2) 

(D.2) lim V " +1 + " 4 " ={p + l)p a.s. 

n— »+oo n 

Furthermore, it follows from Wei's Lemma that for all 5 > 1/2, 
(D.3) V' n = o(n 5 ) a.s. 



Therefore, we infer p5j|, pl2| and (|D\3]) that 
(D.4) 



1 



lim — A' = (p + l)p a.s. 



Finally, by the same lines as in the proof of the first part of Theorem 5.3 
we find that 

R n A' 

lim — = 2 lim — - = 2(p-\- \)p a.s. 

n— >oo n n— >oo 77, 



□ 



which completes the proof of convergence (9.2). 
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